Examining the sense of agency in human-computer interaction

Humans are agents, we feel that we control the course of events on our everyday life. This refers to the Sense of Agency (SoA). This experience is not only crucial in our daily life, but also in our interaction with technology. When we manipulate a user interface (e.g., computer, smartphone, etc.), we expect that the system responds to our input commands with feedback, as we desire to feel that we are in charge of the interaction. If this interplay elicits a SoA, then the user will perceive an instinctive feeling of “I am controlling this”. Although research in Human-Computer Interaction (HCI) pursuits the design of intuitive and responsive systems, most of the current studies have been focussed mainly on interaction techniques (e.g., software-hardware) and User Experience (UX) (e.g., comfort, usability, etc.), and very little has been investigated in terms of the SoA i.e., the conscious experience of being in control regarding the interaction. In this thesis, we present an experimental exploration of the role of the SoA in interaction paradigms typical of HCI. After two chapters of introduction and related work, we describe a series of studies that explore agency implication in interaction with systems through human senses such as vision, audio, touch and smell. Chapter 3 explores the SoA in mid-air haptic interaction through touchless actions. Then, Chapter 4 examines agency modulation through smell and its application for olfactory interfaces. Chapter 5 describes two novel timing techniques based on auditory and haptic cues that provide alternative timing methods to the traditional Libet clock. Finally, we conclude with a discussion chapter that highlights the importance of our SoA during interactions with technology as well as the implications of the results found, in the design of user interfaces

QuintEssence: A Probe Study to Explore the Power of Smell on Emotions, Memories, and Body Image in Daily Life

Previous research has shown the influence of smell on emotions, memories, and body image. However, most of this work has taken place in laboratory settings and little is known about the influence of smell in real-world environments. In this paper, we present novel insights gained from a field study investigating the emotional effect of smell on memories and body image. Taking inspiration from the cultural design probes approach, we designed QuintEssence, a probe package that includes three scents and materials to complete three tasks over a period of four weeks. Here, we describe the design of QuintEssence and the main findings based on the outcomes of the three tasks and a final individual interview. The findings show similar results between participants based on the scent. For example, with cinnamon, participants experienced feelings of warmth, coziness, happiness, and relaxation; they recalled blurred memories of past moments about themselves and reported a general feeling of being calm and peaceful towards their bodies. Our findings open up new design spaces for multisensory experiences and inspire future qualitative explorations beyond laboratory boundaries

Agency in mid-air interfaces

Touchless interfaces allow users to view, control and manipulate digital content without physically touching an interface. They are being explored in a wide range of application scenarios from medical surgery to car dashboard controllers. One aspect of touchless interaction that has not been explored to date is the Sense of Agency (SoA). The SoA refers to the subjective experience of voluntary control over actions in the external world. In this paper, we investigated the SoA in touchless systems using the intentional binding paradigm. We first compare touchless systems with physical interactions and then augmented different types of haptic feedback to explore how different outcome modalities influence users’ SoA. From our experiments, we demonstrated that an intentional binding effect is observed in both physical and touchless interactions with no statistical difference. Additionally, we found that haptic and auditory feedback help to increase SoA compared with visual feedback in touchless interfaces. We discuss these findings and identify design opportunities that take agency into consideration

Multisensory Integration as per Technological Advances: A Review

Multisensory integration research has allowed us to better understand how humans integrate sensory information to produce a unitary experience of the external world. However, this field is often challenged by the limited ability to deliver and control sensory stimuli, especially when going beyond audio–visual events and outside laboratory settings. In this review, we examine the scope and challenges of new technology in the study of multisensory integration in a world that is increasingly characterized as a fusion of physical and digital/virtual events. We discuss multisensory integration research through the lens of novel multisensory technologies and, thus, bring research in human–computer interaction, experimental psychology, and neuroscience closer together. Today, for instance, displays have become volumetric so that visual content is no longer limited to 2D screens, new haptic devices enable tactile stimulation without physical contact, olfactory interfaces provide users with smells precisely synchronized with events in virtual environments, and novel gustatory interfaces enable taste perception through levitating stimuli. These technological advances offer new ways to control and deliver sensory stimulation for multisensory integration research beyond traditional laboratory settings and open up new experimentations in naturally occurring events in everyday life experiences. Our review then summarizes these multisensory technologies and discusses initial insights to introduce a bridge between the disciplines in order to advance the study of multisensory integration

It Sounds Cool: Exploring Sonification of Mid-Air Haptic Textures Exploration on Texture Judgments, Body Perception, and Motor Behaviour

Ultrasonic mid-air haptic technology allows for the perceptual rendering of textured surfaces onto the user's hand. Unlike real textured surfaces, however, mid-air haptic feedback lacks implicit multisensory cues needed to reliably infer a texture's attributes (e.g., its roughness). In this paper, we combined mid-air haptic textures with congruent sound feedback to investigate how sonification could influence people's (1) explicit judgment of the texture attributes, (2) explicit sensations of their own hand, and (3) implicit motor behavior during haptic exploration. Our results showed that audio cues (presented solely or combined with haptics) influenced participants' judgment of the texture attributes (roughness, hardness, moisture and viscosity), produced some hand sensations (the feeling of having a hand smoother, softer, looser, more flexible, colder, wetter and more natural), and changed participants' speed (moving faster or slower) while exploring the texture. We then conducted a principal component analysis to better understand and visualize the found results and conclude with a short discussion on how audio-haptic associations can be used to create embodied experiences in emerging application scenarios in the metaverse

Responsible Innovation of Touchless Haptics: A Prospective Design Exploration in Social Interaction

The rapid development of touchless systems has introduced many innovations in social interaction scenarios in recent years. People now can interact with touchless systems in social applications that are aimed to be used in everyday situations in the future. This accelerated development makes us ask, what will the next generation of touchless systems be like? How can we responsibly develop new touchless technologies in the future? To answer the first question, we brought together 20 experts to ideate, speculate, and evaluate possible touchless applications for social interactions. A total of 48 ideas were generated from two consecutive workshops. Then, to answer the second question, we critically analyzed those ideas through a thematic analysis using a responsible innovation (RI) framework, and identified key ethical considerations to guide developers, practitioners when designing future touchless systems. We argue that the social scenarios described, and the RI framework proposed in this paper are a useful starting point for responsibly designing the next generation of touchless systems

Virtually tasty: An investigation of the effect of ambient lightning and 3D-shaped taste stimuli on taste perception in virtual reality

Taste perception is influenced by sensory information not only about the food itself but also about the external environment where the food is tasted. Prior studies have shown that both visual attributes of the environment (e.g., light colour, location) and the shape associated to food (e.g., plates, cutlery) can influence people's taste perception and expectations. However, previous studies are typically based on non-edible shapes usually shown as 2D images or presented as 3D tangible objects aimed to be perceived by subjects' hand. Therefore, the effect of mouthfeel of differently shaped foods on taste perception remains unclear. Capitalising on the advantages of virtual reality (VR) to manipulate multisensory features, we explore the effects of coloured (red, blue, neutral) virtual environments on the taste (sweet, neutral) perception of differently shaped taste samples (rounded/spiky shapes according to the Kiki-Bouba paradigm). Overall, our results showed increased ratings of sweetness when participants tasted Bouba-shaped samples (rounded) relative to Kiki-shaped samples (spiky) suggesting that tactile attributes perceived inside the mouth can influence sweetness perception. Furthermore, we concluded that lighting colour in a virtual setting might dampen experiences of sweetness. However, this effect may only be present when there is a cross-modal correspondence with taste. Based on our findings, we conclude by describing considerations for designing eating experiences in VR

Walker 256 tumor growth suppression by crotoxin involves formyl peptide receptors and lipoxin a(4)

We investigated the effects of Crotoxin (CTX), the main toxin of South American rattlesnake (Crotalus durissus terrificus) venom, on Walker 256 tumor growth, the pain symptoms associated (hyperalgesia and allodynia), and participation of endogenous lipoxin A(4). Treatment with CTX (s.c.), daily, for 5 days reduced tumor growth at the 5th day after injection of Walker 256 carcinoma cells into the plantar surface of adult rat hind paw. This observation was associated with inhibition of new blood vessel formation and decrease in blood vessel diameter. The treatment with CTX raised plasma concentrations of lipoxin A 4 and its natural analogue 15-epi-LXA(4) 4, an effect mediated by formyl peptide receptors (FPRs). In fact, the treatment with Boc-2, an inhibitor of FPRs, abolished the increase in plasma levels of these mediators triggered by CTX. The blockage of these receptors also abolished the inhibitory action of CTX on tumor growth and blood vessel formation and the decrease in blood vessel diameter. Together, the results herein presented demonstrate that CTX increases plasma concentrations of lipoxin A 4 and 15-epi-LXA 4, which might inhibit both tumor growth and formation of new vessels via FPRs.Coordenacao de Aperfeicoamento de Pessoal de Nivel Superior (fellowship-CAPES)PAP (fellowship-Secretaria da Saude do Estado de Sao Paulo)FAPESP [07/52447-8]Guggenheim FoundationSpecial Laboratory of Pain and Signaling, Butantan Institute, Avenida Vital Brazil 1500, 05503-900 São Paulo, SP, BrazilCEIS/Department of Biology, Institute of Biosciences of Rio Claro, São Paulo State University (UNESP), Rio Claro, SP, BrazilLaboratory of Pathophysiology, Butantan Institute, Avenida Vital Brazil 1500, 05503-900 São Paulo, SP, BrazilDepartment of Natural Sciences, Mathematics and Education, Agricultural Sciences Center, Federal University of São Carlos, Rodovia Anhanguera Km 174, 13600-970 Araras, SP, BrazilLaboratory of Inflammation and Vascular Pharmacology, Federal University of São Paulo, Rua São Nicolau 210, 09913-030 Diadema, SP, BrazilDepartment of Physiology and Biophysics, Institute of Biomedical Sciences, University of São Paulo, Avenida Professor Lineu Prestes 1524, 05508-900 São Paulo, SP, BrazilDepartment of Pharmacology, Institute of Biomedical Sciences, University of São Paulo, Avenida Professor Lineu Prestes 1524, 05508-900 São Paulo, SP, BrazilLaboratory of Inflammation and Vascular Pharmacology, Federal University of São Paulo, Rua São Nicolau 210, 09913-030 Diadema, SP, BrazilFAPESP: 07/52447-8Web of Scienc